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Abstract 

This paper draws distinctions among various concepts related to tipping points, ro- 
bustness, path dependence, and other properties of system dynamics. For each concept 
a formal definition is provided that utilizes Markov model representations of systems. 
We start with the basic features of Markov models and definitions of the foundational 
concepts of system dynamics. Then various tipping point-related concepts are described, 
defined, and illustrated with a simplified graphical example in the form of a stylized 
state transition diagram. The tipping point definitions are then used as a springboard 
to describe, formally define, and illustrate many distinct concepts collectively referred 
to as "robustness" . The final definitional section explores concepts of path sensitivity 
and how they can be revealed in Markov models. The definitions provided are presented 
using probability theory; in addition, each measure has an associated algorithm using 
matrix operations (excluded from current draft). Finally an extensive future work sec- 
tion indicates many directions this research can branch into and which methodological, 
conceptual, and practical benefits can be realized through this suite of techniques. 
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1 Introduction 



The idea of tipping points has captured the public's attention from topics as diverse as seg- 
regation, marketing, rioting, and global warming. Robustness considerations have extended 
beyond engineering and ecology to political regimes, computer algorithms, and decision 
procedures. Analyzing and exploiting path dependence plays a significant role in technol- 
ogy spread, institutional design, legal theory and the evolution of culture. However these 
concepts have not been generally and formally defined and, as a result, the terms' uses 
across these various applications are hardly consistent. At times a tipping point refers to a 
threshold beyond which the system's outcome is known. Other times 'tipping point' is used 
to describe an event that suffices to achieve a particular outcome, or an aspect of such an 
event, or the time of such an event. Another use of tipping points is to label the conditions 
to which the system is most sensitive. The idea is frequently tied up with processes such as 
positive feedback, externalities, sustainable operation, perturbation, etc. Robustness and 
path dependence share also in this preponderance of senses and this paper aims to elucidate 
the distinctions among these and other uses of the terms. 

To accomplish this conceptual analysis this paper puts forth formal definitions for each 
concept (with an implied algorithm) to measure properties of system dynamics. The analysis 
utilizes Markov model representations of systems and so definitions of the foundational 
concepts of system dynamics (equilibrium, basin of attraction, support, etc.) are first 
provided. Then various tipping point-related concepts are described, defined, and illustrated 
with a simplified graphical example. This treatment is then repeated for robustness-related 
concepts and then again for a variety of path sensitivities in system dynamics. 

An additional section identifies projects for future work in considerable detail. Through 
presentations and conversations the techniques presented here have garnered considerable 
interested from within academics and from government and industry. The next step is 
clearly to apply these measures to existing data and models to refine the measures and con- 
tribute to science. A planned extension provides a methodology (and software) to (automat- 
ically) generate the state transition representation from observational and model-generated 
data. This software tool is necessary for many of the intended and most useful applications 
of these measures. There is an additional and unexpected potential conceptual benefit 
to the robustness formalization presented here for the philosophical study of dispositional 
properties. Dispositions such as fragile, soluble, and malleable have long resisted necessary 
and sufficient conditions to distinguish them from categorical properties (like red, liquid, 
and square). The formal definition of one dispositional property (robust) may shed some 
conceptual light on how to proceed. Other research thrusts that extend the conceptual and 
methodological benefits of what follows are also presented. 

2 Background 

This paper applies methods from ergodic theory, network theory and graph theory to whole 
systems encoded as Markov models to find and measure tipping points, robustness, and 
path sensitivity in system dynamics. The fusion of these techniques to this purpose is 
novel, but certainly there is nothing unprecedented about analyzing systems to find these 
properties or modeling dynamics with Markov models. But since this paper represents the 
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first marriage of these two realms, the story thus far must be told as two separate threads. 
2.1 Tipping Points, Robustness, and Path Dependence 

Much previous work in finding and measuring properties of system dynamics has focused 
on explanation - the answering of the 'why' question. Not surprisingly since these papers, 
books, and discussions were couched in scientific contexts where a particular phenomenon 
(or class of phenomena) required explanation. Each such jaunt into explaining tipping 
points, robustness, or path dependence was accompanied by a custom-suited methodology 
capable of generating and detecting that property in the model provided (to answer the 
'how' question). These models achieved varying levels of generality, but each was limited 
by the desire to explain the property in a particular model or context. This is limiting 
because in order to explain how a process generates (say) path dependent behavior one has 
to model that process explicitly. 

The current work is one of pure methodology rather than a purported model of any 
particular system or causal apparatus. It is meant to be completely abstract and general 
and therefore capable of measuring these system properties in any system. Because it does 
not model any generating process it cannot address the 'why' or 'how' questions. It is not 
meant to. This paper answers the 'whether' and 'how much' questions. These questions 
are also asked in previous work, but results could not be compared between models because 
the methodology was model-specific. A general methodology provides a framework through 
which all modelers (and some data analysts) can determine whether and how much of 
each of these properties of system dynamics obtains . . . and compare results across models 
regardless of the generating mechanisms. The ability to compare measures across systems 
is achieved through a focus on scale-free measures - measures that do not depend on the 
size of the system being analyzed. This framework allows scientists to focus on making 
appropriate models of their subject-matter by eliminating the burden of figuring out how 
to measure these properties for their model. Here I review some previous work that includes 
the similar measured properties to highlight where this methodology might prove useful. 

2.1.1 Tipping Points 

The term 'tipping point' was first coined by Morton Grodzins in 1957 [9] to describe the 
threshold level of non-white occupants that a white neighborhood could have before "white 
flight" occurred. The term continued to be used in this context through the work of Eleanor 
Wolf [21] and Thomas Schelling [TH] who also extended the concept to other similar social 
phenomena. Though these researchers had a specific usage with narrow focus, the idea of 
a critical parameter value past which aggregate behavior is recognizably different spread 
across disciplines where its meaning and application varied considerably. 

Malcolm Gladwell's pop sociology book The Tipping Point [7| has played a significant 
part in bringing the term to the public's awareness. The notion of tipping point most fre- 
quently used by Gladwell is an event that makes something unusual (such as Hush Puppy 
shoes) become popular. More precisely this is a critical value for producing a phase transi- 
tion for percolation in certain heterogeneous social network structures. This form of tipping 
point behavior also appears in the work of Mark Granovetter [8] and Peyton Young [23] 
for the propagation of rioting behavior and technology respectively. This version of tipping 
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will play only a minor role in what follows, however the fact that the expression has made it 
into the everyman's conceptual vocabulary boosts the importance of establishing rigorous 
scientific definitions to disambiguate loose usage. 

A recent trend in reports of climate change is to refer to a hypothesized tipping point in 
global warming and ice cap and glacial melting. James E. Hansen has claimed that "Earth is 
approaching a tipping point that can be tilted, and only slightly at best, in its favor if global 
warming can be limited to less than one degree Celsius." [3] This usage reflects Hansen's 
belief that "Humans now control the global climate, for better or worse." Gabrielle Walker 
states, "A tipping point usually means the moment at which internal dynamics start to 
propel a change previously driven by external forces. [20]" It is unclear whether Walker's 
and Hansen's comments are compatible; the conceptual ambiguity of the terms may be 
making them talk past each other. But even if their usage is meaningful within their fields, 
they fail as general characteristics. Identifying tipping points (as a property of system 
dynamics) should not depend on whether humans are in control of system behavior or what 
is driving the dynamics (even if explaining why those are the dynamics does). 

But not all heretofore definitions of the term 'tipping point' have been loose or subject- 
matter specific. It is often deployed as a semi-technical term in equation-based models of 
various sorts. For example, it can refer to an unstable manifold in a differential equation 
model, the set of boundary parameters for comparative statistics [T7] , or inflection points 
in the behavior of functional models. Each of these uses of 'tipping points' conforms to our 
intuitive sense of the term's meaning and at some slightly higher level of abstraction these 
tipping behaviors are the same - and match the definitions provided in this paper. But not 
all models can be faithfully represented as systems of equations and this limits the usefulness 
of equation-dependent definitions. One set of tests we can perform on the compatibility of 
current analysis is to generate Markov models based on the existing differential equation 
and comparative static models and then determine whether the definitions provided here 
identify the same states as tipping points. Such a project is left for future work. 

2.1.2 Robustness 

Robustness considerations are already a common analysis path for researchers in many 
fields: ecology, engineering, evolutionary biology, logistics, computer science, decision the- 
ory, and even statistics. Models in these fields are often developed specifically to enhance 
system robustness, avoid system failures, mitigate vulnerabilities, and otherwise cope with 
variations in an unpredictable environment. These previous analyses provide some under- 
standing of what features make certain systems persist and others fail, but there is little in 
the area of general theory. One hope is that the present construction of general measures 
of robustness-related concepts will inform and facilitate the construction of general theories 
of what systemic features produce these properties of system dynamics. If it can reveal 
that robust configurations and dynamics in these varied fields can be captured by a single 
measure, then we will have taken the first step towards a unified theory of robustness. 

Understanding how social systems can be both simultaneously flexible and strong has 
garnered increasing interest recently. In an upcoming book Jenna Bednar investigates how 
institutional design can affect the robustness of a federalist governing body [lj. "By explic- 
itly acknowledging the context dependence of institutional performance, we can understand 
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how safeguards intersect for a robust system: strong, flexible, and able to recover from 
internal errors." Bednar has identified the properties that make institutional system robust 
(compliance, resilience, and adaptation) in a way that is somewhat specific to the subject 
matter. That is beneficial and to be expected for explaining and improving the robustness 
of political institutions. Such an analysis stands to gain from the conceptual refinements 
derived from formal measures of multiple robustness-related features of system dynamics. 
Bednar's work especially underlies the thought that understanding many systems of interest 
requires more than traditional equilibria analysis; the dynamic nature of dissipative struc- 
tures (see example 7.5) requires new notions of stability, resilience, and robustness that I 
hope to help inform through the provided measures. 

Thomas Sargent has made extensive use of principles from robust control theory in his 
analysis of monetary policy and pricing (and other topics). The sense of 'robustness' used in 
robust control theory is a gap between modeled levels and actual levels of parameters. It is 
used to formalize misinformation, uncertainty, and lack of confidence in agents' knowledge 
and, more generally, to facilitate high levels of performance despite errors and in known less- 
than-ideal conditions. This sense of robustness applies across the decision theoretic sciences 
and planning literature (e.g. the work of Rob Lempert and company [12]). However, not 
all robustness analyses are to cope with uncertainty. 

In genetics the term robustness refers to a species' consistency of phenotype through 
changes in the genotype. Robustness can be considered at two levels: 1) through how much 
mutation is a member of a species viable and 2) how much genetic variation is required 
to transform a species' physical characteristics. The first level takes genetic profiles of 
organisms and determines which can survive to reproductive age and which cannot (or 
are sterile). The number of genotypic variations that remain viable is a measure of the 
species' robustness . . . according to that usage. On the evolutionary time scale we wish 
to understand how incremental genetic drift is responsible for large phenotypic variations 
over time. Walter Fontana has demonstrated that a network of neutral mutations (ones 
that do not affect fitness) can sufficiently explain the observed punctuated equilibria (see 
example 7.4) in species evolution [5 . Though fitness may remain neutral through some 
genetic variation, the connection between fitness change and phenotype change is strong. 
A model that tracks fitness through genetic variations could then approximately measure 
how robust each stage in the evolutionary progression is. It is clear that these two concepts 
of robustness are distinct; and they are both distinct from control and decision theories' 
usage as well. 

We can add robustness measures from statistics and computer science to the variety of 
senses that 'robustness' can take. In computer science an algorithm, procedure, measure, 
or process is robust if small changes (errors, abnormalities, variations, or adjustments) have 
a proportionally small affect on the algorithm, procedure, measure, or process. The time 
complexity of two algorithms may change in different ways. Algorithm A may require 
one step per input (O(n)) and Algorithm B may require one step per two to the power 
of the input size (0(2")); in this case algorithm A is more robust to changes in input 
size. Statistical robustness is either when an estimator performs sufficiently well despite the 
assumptions required by that estimator being violated or when (like in computer science) 
a measure changes little compared to changes in the input. For example, the median is a 
more robust measure than the mean because to alter the median a data point has to cross 
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the median point, whereas any input value change will change the mean's value. 

And there are more variations in information theory, data security, engineering, law, 
ecology, and just about every field has their own version of robustness. They all share certain 
high-level conceptual commonalities, but differ in their details and criterion for application. 
The definitions below produce necessary and sufficient conditions for the application of 
several robustness- related concepts. There are many different ways in which systems can 
cope with variation are each has its own definition. This level of refinement (combined with 
a very inclusive Markov modeling technique) may be able to bring discussions of robustness 
in the different fields to a single table and foster inter-discipline research. 

2.1.3 Path Dependence 

The level of interest in explaining path dependent processes has risen in recent years. This 
is in part due to an overall appreciation for the importance of such dynamics in complex 
systems across domains. This is also partly due to a natural need to explain observed 
path dependent phenomena such as convention lock in (e.g. QWERTY keyboards), climate 
change, and political instability. And another part is due to an increased prevalence in 
models wherein path dependence could potentially be formally measured. Each technique 
to measure path dependence requires a definition to characterize path dependence in a 
manner measurable by the formal machinery presented. Because previous work focused on 
explaining path dependence through demonstrating sufficient mechanisms to generate it, 
and this paper's goals are to provide a general system-level definition and way to measure 
it, the current work will only barely touch on previous research. Yet insofar as the definitions 
should be compatible it is worth taking a look at previous, recent formal definitions of path 
dependence in the literature. 

According to James Mahoney [T3| there are three basic characteristics of path depen- 
dence in the social science literature. The first type of path dependence appreciates sensitiv- 
ity to events that take place in the early stages of a sequence of events. Secondly, there are 
some historical events early in the sequence that are not explained by prior events. Finally, 
the sequence of events exhibit some kind of "inertia" culminating in an equilibrium-type 
outcome. Though later analyses (including this one) deny these characteristics in favor of 
other ones, this work does demonstrate some popular thoughts in the formal literature on 
path dependent processes. Paul Pierson presents one definition that contrasts with Ma- 
honey's. In Pierson's work path dependence describes how early historical events act to 
select among multiple possible equilibria. This equilibria selection process, however, is due 
to exogenous shocks to the system, a characterization which does not seem necessary for a 
definition of path dependence. It does ring true that if only one equilibria-like outcome is 
possible then system ought to be characterized as path independent (or at least that the 
outcome be characterized as path-independent). 

Kollman & Jackson have a variant of Page's definition of path dependence (see below) 
- one that applies only to specifically parameterized dynamical system models and requires 
"very specific and stringent conditions in order for there to be path dependence |1 
Path dependence is revealed when a certain time-varying autoregressive parameter is (or 
converges to) one as the system's dynamics progress through specified shocks. One of their 
results is that "Several steps ought to be taken prior to proposing that some process is 
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path dependent. Such a proposal should be based on rigorous analysis of the process at 
issue. We cannot offer a set of computational tools that can be used 'off the shelf.' There 
is no substitute for theoretical modeling appropriate to the system under study as a first 
step.|ll|" Indeed, building a data-generating model is a necessary first-step for measuring 
path dependence in most cases. However, if data satisfies certain properties (described in 
the next section) then the methodology presented in this paper can be used "off the shelf" 
to measure the degree of many forms of path dependence (see Automatically Generating the 
Markov Model in the future work section for more details) If one is primarily interested 
in finding out whether and how much path dependence a process produces, however, the 
model need not be specified with the details required by their methodology. Such model- 
level tinkering is only necessary to provide an explanation of whence the path dependence. 
But if we accept that there are very many mechanisms that can generate path-dependence 
and that this feature of the mechanisms will be revealed through the data they produce, then 
we can ignore the mechanisms' specifics when measuring their degrees of path dependence. 
This is the approach taken here. 

The work of Scott Page in identifying the types and causes of path dependence jT5] 
is closest in flavor to the work presented here. Though again an example of mechanism 
identification, the motivation identified in his introduction applies equally to this paper and 
is worth including here. 

Attempts to extend what is meant by path dependence reflect a need for a finer 
unpacking of historical causality. We need to differentiate between types of 
path dependence. The way to do that is with a formal framework. An obvious 
advantage of having such a framework is that we can conduct empirical analyses 
and discern whether the evidence supported or refuted a claim of the extent and 
scope of the sway of the past. That said, empirical testing of a framework of 
causality is far from the only reason for constructing a framework for modeling 
historical forces. Formal models discipline thicker, descriptive accounts [6|- By 
boiling down causes and effects to their spare fundamentals, they enable us to 
understand the hows and whys; they tell us where to look and where not to look 
for evidence. They also help us to identify conditions that are necessary and/or 
sufficient for past choices and outcomes to influence the present. [15] 

The differences that Page recognizes in the underlying forces driving law making, pest con- 
trol, or technology choice are points well taken. Insofar as the different forces generate 
differentiable system dynamics the techniques of this paper will be able to identify and 
precisely measure how much and in what ways past states influence the future. The prop- 
erties defined through the formal framework presented below is intended to guide scientists 
towards characteristics of the original system that merit closer examination. 

2.2 Markov Modeling, Network Theory, Graph Theory, etc. 

Markov modeling has a long history in mathematics, engineering, and in applications to 
fields as diverse as condensed matter physics, genomics, sociology, and marketing. Tech- 

x Data from the social sciences, however, is least likely to fulfill these necessary properties (for reasons 
outlined in the opening of the Kollman & Jackson paper) and will therefore usually require the building of 
a model to generate the Markov model upon which this analysis can be run. 
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niques to use Markovian processes to uncover information about system dynamics fall within 
the field of ergodic theory. Several properties and techniques from standard Markov mod- 
eling are employed below. In their abstract form one can compute features such as the 
equilibrium distribution, expected number of steps between two states (with standard devi- 
ation), reversibility, and periodicity. These features gain added meaning when interpreted 
for the system being modeled, but this paper utilizes them as part of defining (and creating 
algorithms to uncover) interesting system dynamic properties. 

Computer scientists have long been analyzing networks in the form of actual communi- 
cation networks as well as various abstractions from these problems. They have invented 
several useful measures and exceptionally well-crafted algorithms to calculate connectedness, 
load-bearing properties, path switching, transmission speed, and packet splitting and fusion 
to name a few. My analysis borrows heavily from this work in terms of algorithms, though 
each has been repurposed to the abstract Markov model system representation. Computer 
science is also the home of finite state machines: mathematical objects that share their 
states & transitions structure with Markov models (though state machines are frequently 
not probabilistic). The states of a finite state machine represent the internal states of some 
agent and the transitions represent the behavior rules by which agents change their states. 
Few of the techniques invented to analyze finite state machines will apply to this research 
because few are adapted to purely probabilistic transitions. 

Hardware engineers and their physicist partners have worked out several interesting 
measures for circuit design problems. Multiple paths, variable resistance, flow injection, 
capacitance and many other characteristics of electronic circuits have analogs in the Markov 
models presented below. Though these are only partially explored at this stage, future work 
will look deeply at borrowing techniques from circuit research. 

And finally graph theory offers a few useful measures for our purposes, and moreover 
provides a wealth of definitions for graph structure and node relationships. Structural 
properties will play a larger role in future work addressing changes of resolution and in 
establishing equivalence classes of system dynamics. Also, many of the features that graph 
theory identifies have been given alternative definitions that underlie the probabilistic nature 
of the Markov model analysis. Few explicit references to previous work in these method- 
ological subjects appear below because the methods used generally fall in the category of 
common knowledge. When a specific algorithm or specialized technique is used, a reference 
is provided. 

3 Motivations and Applications 

The measures defined here are meant to stand on their own as improvements in our con- 
ceptual understanding of the included features of system dynamics. By differentiating and 
formally defining these properties of processes we gain both a common vocabulary with 
which to discuss our models and a detailed typography of behavior to include and detect in 
system models. Many of the applications I have in mind are to include these measures in 
constructive models across multiple disciplines where the models are iterated with multiple 
initial settings and/or have stochastic parameters. These include game theoretic models, 
network models, physical models, and the whole gamut of models which may be considered 
agent-based. 
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Certain static data sets, the sorts collected by surveys, are also analyzable via this 
methodology The data must satisfy certain criteria to be thus analyzable - basic prop- 
erties it must have before even considering the statistical issues involved with particular 
applications. There must be 

1. Data across time (because we're measuring properties of dynamics) 

2. Repeated system states (so the Markov model isn't deterministic) 

3. Known (or known to be fixed) time between observations 

To have repeated system states from collected data we typically will need data from 
multiple independent trials. In some cases independence will not be true but will be a 
useful/necessary approximation. For example, voter data from each state or county are 
not truly independent, but each state or county could constitute a separate trial. In many 
ways these considerations parallel issues already present in statistical analysis, though the 
motivation for these requirements are quite different. Other features of typical statistical 
analysis will also show up in this technique's application (e.g. correlation, covariance, fixed 
effects, kurtosis), but they will not be highlighted except where doing so enhances the 
discussion. 

In some cases the data may be recoded or otherwise translated into system states in 
such a way to as to highlight those features of the system we wish to track and uncover the 
tippiness, robustness and path sensitivities of. In some cases this will be a resolution choice, 
in others this will be a shift to recording Markov states as rate changes, and in others it 
may be converting fixed-time dynamics into event-drive dynamics. It will take expertise 
to determine which, if any, conversion is necessary and a great deal of trial and error to 
develop that expertise. Eventually standards will be uncovered as people build proficiency 
in this methodology. 

A final consideration has nothing to do with the structure and format of the data. Even 
if the data is amenable to the analyses presented below, the data may not be observations 
from a system for which we think robustness or path sensitivity apply. For example, even 
if we could run the robustness analysis on voter data, it is not clear what the result would 
be telling us. Similarly, given any set of real numbers we can calculate the mean value, 
but there is no useful interpretation of that mean value for some sets of real numbers (e.g. 
telephone numbers). Path sensitivity, however, is something we expect to uncover in poll 
data and so the amenability of the voter data to the Markov modeling enables this analysis. 
The modeling and analysis techniques need to be both possible and appropriate, but only 
a human can determine appropriateness. 

3.0.1 Autonomic Resource Management 

One promising application of the measures and methods defined in this paper is in devel- 
oping self-managing large-scale systems - so-called autonomic systems. Autonomic systems 
apply top-down measures of their internal mechanisms to adapt to changes in resource needs 
and availability. Some computer systems, such as internet routers, satellites, autopilots, and 
explorer robots, use autonomic management programs. Another major application could be 
logistics management: the routing of parcels, fuel, food, luggage, etc. to minimize service 
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breakage and costs. With formal measures of robustness in hand (especially in combination 
with understanding of path sensitive trajectories) these systems could guide themselves to 
maintain their function and cope with environmental perturbations using levers uncovered 
through the analyses presented below. Because my research extends into each of these re- 
search arms the potential gain for having these measures constitutes a significant personal 
motivation to develop them. 

4 Defining a Markov Model 

At its most basic a Markov model is a collection of states and a set of transition probabili- 
ties between pairs of states. There are several ways to represent a Markov model, but the 
standard techniques are to 1) model the states as vertices (nodes) and the transition proba- 
bilities as weighted edges of a graph or 2) use such a graph's corresponding adjacency matrix 
or edge list. Different applications of Markov modeling take different system features as 
the states, but the nodes in the Markov models used here represent a complete description 
of a state of the system (see below) . The transition probabilities represent either observed 
system dynamics or theoretically posited state changes. Given that states and transitions 
are defined this way it is clear that the set of states and their transition probabilities are 
constant for the Markov models utilized in this paper. 

Before beginning the breakdown of the aforementioned phenomena into their various 
categories, a general typology of state spaces will be helpful. A system state is a complete 
set of instantiations of the aspects of the system (values for variables, existence for agents, 
etc.). Throughout we will analyze systems with a finite (but possibly arbitrarily large) 
number of states each with a finite number of aspects. Insofar as some parameters may 
take on unbounded values (e.g. a continuum of real values) bounding the number of the 
parameters (i.e. dimensionality of the parameter space) does not ensure a bounded or 
discrete state space. The analysis that follows is limited to a finite, discrete state space 
achieved by binning continuous parameters. 

Definition 4.1. A state in the Markov model is a complete specification of the Q aspects 
of one configuration of the system. 

Si = {X 1 ( i -),X 2 (i), ■ ■ ■ AQ(j)} 
where X h /^ is the value of aspect h in state i 

Definition 4.2. Two states are represented as one state of the Markov model if all the 
aspects of the two states are identically valued. 

Si = Sj 44> Mh X h{ fi = X h (j) 

An obvious (but still useful) corollary results directly from the truth values of bicondi- 
tional equivalence. 

Corollary 4.1. A difference in any aspect marks a different state of the system. 

3h X h (i) / X h( j) 44> Si^ Sj 
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Example 4.1. If our system is an iterated strategic-form game played by six players 

Pi G {P1,P2,...,P6} 

each with four possible actions 

a(Pi) G {al,a2,a3,a4} 

then each state of the system has six aspects and each aspect takes on one of four values. 
That is 

Si = {a(Pl (i) ),a(P2 (i) ),...,a(P6 (i) )} 

and a particular state S3 might be {a3, a2, a3, al, a4, a3}. There are 6 4 = 1296 combinations 
of four actions for six players, but the Markov model may not include all of them. Recall 
that the model is expected to be built from either collected data or a theoretical model 
so some combinations of aspect values may be unobserved or theoretically impossible or 
irrelevant. 

Example 4.2. To analyze Schelling's segregation model [19] we have several options for how 
we capture the states of the system. Consider an 8 x 8 grid with 50 agents of two types. 
We could choose to track the x and y coordinates of each agent in the model which would 
generate states with 100 aspects (two for each agent). We could instead track whether each 
agent is happy with its neighborhood so there would be 50 binary {yes, no} aspects to 
each state. Alternatively the aspects could represent what is in each of the 64 grid spaces 
with values from {empty, agent typel, agent type2}. Note that not all 3 64 combinations 
are possible because there are fixed numbers of each type of agent and two grid spaces 
change every transition (agent moving). These and other specifications could be combined 
with each other and/or measures of the configuration (e.g. how clustered the agents are). 
The choice of what to count as the aspects of the states will determine what the measures 
defined below can reveal. 

A set of n states is demarked with boldface type: S = {Si, S2, ■ ■ ■ S n }. The set of all 
the states in the Markov model is N which has size |N| = N - thus ./V is also the number of 
nodes in the graph representation. The state of the system at time t (denoted st) changes to 
St+x in discrete, homogenous time intervals. State transitions are probabilistic and specified 
by the system's transition diagram or matrix (see figure [TJ. We write the probability of 
transitioning from state Si to state Sj as Pij := P(st+i = Sj\st = Si). It will later be useful 
to denote the set of transitions E and the size of this set as |E|. 

Following the standard definition from probability theory: 

Definition 4.3. The sum of a state's exit probabilities must equal one. 

VS G N P(st+i = Sj\s t = Si) = l 
j 

The entry in the transition matrix at row i and column j represents Pij and so each row 
must sum to 1. 

Theorem 4.2. The probability of a state change equals the probability that each of the 
aspects of the state changes. 

P(s t+ i = Sjlst = Si) = P(Vh X h>t+1 = X m \X h>t = X m ) 
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Figure 1: Example Equivalent Markov Matrix and Diagram 
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(a) Transition Matrix 



(b) Transition Diagram 



This theorem, which relates state transitions back to changes in their constituent aspects, 
follows directly from definition 4.2 of state sameness and applies to self transitions (i.e. 
Si = Sj) as well. It is important to note that the state change probability is not the sum of 
the aspect change probabilities. Each single or multiple aspect change produces a distinct, 
independent state change with its own probability. This property (and others related to 
aspect changes) will be useful in the discussion of levers below. 



5 Special States and Sets 

To use a Markov diagram to represent system dynamics we will need to define various types 
of system behaviors in terms of system states, sets of states, and state transitions. As a 
preliminary to the common features of system behavior I will present definitions of some 
structural features that will be utilized. 

5.1 Paths 

In graph theory a path (of length £) is typically defined as a set of vertices and edges 
satisfying the schema vo, e\, v±, eg, . . . , ei, V£ where the edge e% links the vertex v%-\ 
to Vi [13 . Self-transitions, which represent both a lack of change and a change too small 
to count as a state change, are an important feature of Markov modeling and hence both 
nodes and edges may be repeated along paths. So 'path' as it is used here is the broader 
notion sometimes called a 'walk' in the graph theory literature. 

Observation 5.1. Since there are neither multi-edge^nor hyper-edge^in a Markov dia- 
gram the set of vertices (or the set of edges) alone is sufficient to uniquely specify a path as 
long as successively repeated vertices (or edges) are interpreted as self-transitions. 

2 Multi-edges are multiple distinct edges between two nodes. 
3 Hyper-edges are edges that connect more than 2 nodes. 
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A path in a Markov model could be denned as a set satisfying the same schema used in 
graph theory, but we will use a slightly different definition to make the probabilistic aspects 
explicit. 

Definition 5.1. A path is an ordered collection of states and transitions such that from 
each state there exists a positive probability to transition to the successor state within the 
collection. A path from Si to Sj denoted S(Si, Sj) or Si Sj is the set of states S such that 

(i) s = Si £ S 

(ii) 3T Vt < T P(s t+1 e S\s t e S) > 
(hi) st = Sj G S 

This definition establishes necessary and sufficient conditions for S to be a path, but 
does not provide a schema for specifying a particular path. To specify intermediate states 
(markers) for the system to pass through we can write Si Sj Sk to denote a path from Si 
to Sk that passes through (at least) Sj. Such a path is merely the conjunction of the two 
subpaths S{ Sj and Sj S^. Any number of markers can be thus specified. The order of the 
states specified must be satisfied by the path taken, but it does preclude other states from 
being visited between the marked states. To specify a long sequence of path markers this 
paper uses the notation S(So, Si, ... , St)- 

> 

To completely specify each state along a path we adopt the notation Si . . . Sj for short 
sequences and S(Sq, Si, . . . , St) for long ones. 



Theorem 5.2. An exact path (S) satisfies definition 5.1 of a path above. 



Proof. S(Sq, Si, ... , St) = U^Lo 1 ^* = \Jt=o(St &t+l) where for each subpath the T 

in item (ii) of definition 5.1 equals 1. □ 

Though the term 'transition' appeared above in the general description of Markov mod- 
els, it was not defined precisely. 



Definition 5.2. The transition from Si to Sj is S-i Sj. 

Definition 5.3. The length of a path is the number of transitions taken between the first 
and last states. 

T-l 

£ 

t=o 



e(S(S i ,...,S j )):=y2\{sT^i}\ 



This (possibly overly complicated) formal definition of length simply uses features of 
the definition of path above, but it is equivalent to the number of edges traversed along the 
path. 

Theorem 5.3. A path built from a set of states is at least as long as the number of states 
in the set. 

£(S) > |S| 



14 



This theorem follows from the fact that states may be revisited along the path. The 
definition of length suffices for completely specified paths, but the length of merely marked 
paths can take a range of values depending on the exact sequence of nodes visited. 

Definition 5.4. A cycle is a path that starts and ends with the same state. 

Si Si 

Observation 5.4. A cycle of length one is a self -transition. 



This observation follows directly from the definition of a transition and theorem 5.2 



Definition 5.5. An elementary path is a path that visits each state within the path exactly 
once 

From this definition it is clear that an elementary path is a path with no cycles - including 
no self-transitions. A restriction to elementary paths is particularly helpful for ascertaining 
certain features (e.g. path existence) because simple algorithms exist for them and because 
of the following property. 

Observation 5.5. The length of an elementary path equals the number of states in the 
path. 

Though this fact obviously follows from the definition of path with the exclusion of 
cycles, providing a formal definition is trivial and obvious and will be omitted. 



Figure 2: Example Paths and Cycle 




Graph and network theorists have developed a great many algorithms for finding paths, 
calculated their lengths, and measuring properties germane to their application in those 
fields. Some of those will come up later in measuring properties of system dynamics, but 
the definitions and theorems presented above will suffice to move forward in examining our 
Markov models. 
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5.2 Landmarks in System Dynamics 

This subsection provides definitions and sketches of some algorithms for common structural 
properties of Markov models used to represent system dynamics. Many of these features 
have existing definitions in terms of matrix operations or limiting distributions, but this 
paper will present alternative definitions in many cases. The definitions will make focused 
use of the finitude of the Markov models, the resolution of the states, and the granularity of 
the probability measurements. My motivation for the alternative definitions is to facilitate 
clear intuitions about a system's processes and how to measure them precisely. 

Definition 5.6. A system state that always transitions to itself is called an equilibrium or 
stable state^ An equilibrium e, is a state Si such that 

P(s t +i = Si\s t = Si) = 1. 

In some cases a set of states plays a role similar to that of an equilibrium. 

Definition 5.7. An orbit is a set of states such that if the system enters that set it will 
always revisit every member of the set and the system can never leave that set. S is an 
orbit if 

Vi $h P{s t+h = S t g S\s t g S) = 

and 

Vi Vh > P{s t+h = S l ^ S\s t G S) = 0. 
Definition 5.8. An oscillator is an orbit that is also a cycle. 
Theorem 5.6. Equilibria cannot be proper subsets of an orbit 



Proof. Assume ej G S or bit- From definition 5.7 flh such that P(st+h = Si G S or &jt|st G S 



0. Since ei is in S or bit definition |5 . 7| implies 3hP(s t +h = ei|s* G S) > 0. Definition |5 . 6| implies 
that V/i P(st+h = £i\st = ej) = 1 which further implies that V7t P(st+h / &i\st = e,) = 0. 
For all Sj / ej, yhP(s t +h = Sj\ s t = &i) = 0. Therefore by contradiction with definition |5.7| 

e i T Sorbit- D 

Observation 5.7. Given the definitions of equilibrium and orbit above it is clear that an 
equilibrium is an orbit of just one state. 

Definition 5.9. An Attractor (denoted Aj) is either an equilibrium state or an orbit of the 
systemj^] 

4 As will be defined formally in definition |7.l[ stability refers to a tendency to self-transition. Hence an 
equilibrium is equivalent to a fully stable state. 

5 Though different formulations, the above definitions identify the same states as the standard equilib- 
rium distribution definitions from ergodic theory. The equilibria and orbits are those states with positive 
probability after a "long period of time" . Given a Markov model represented by the transition matrix M 
the attractor states in A are those where P{M T (Si)) > as T -> oo. Or in a more computable formulation, 
given a desired degree of significance for the probability measures 3T* such that P(M T " (S,)) > if and 
only if Si is an attractor state. Although it becomes a little more complicated if one wants to isolate the 
individual equilibria and orbits. Techniques (such as this one) for measuring properties (whether mathe- 
matical or computational) will be presented in an appendix in future versions and are occasionally referred 
to in this text or in footnotes. 
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The choice of a resolution determines whether an orbit appears as an equilibrium or vice 
versa. In cases where attractor avoidance is the aim of the model (see tipping and robustness 
below) we can collapse orbits into a single attractor state without loss of information. For 
this reason I will use l Ai as if it were a single state except in cases where it being an orbit 
affects the analysis. 



In later sections we will encounter the idea of a dissipative structure (see example 7.5 ) for 
which equilibria analysis is inappropriate. It is not the case that these systems fail to have 
attractors, it's just that the goal of such systems is to remain in continual flux and avoid 
equilibria and other "point attractors" (i.e. attractors that incorporate a small percentage 
of the total number of states). Given the definitions established above every Markov model 
must have some set of states satisfying the conditions for being an attractor. 

Theorem 5.8. Every system has at least one attractor. 

N 

3Aj c (J Si 

i=i 

Proof. Assume that there exists a system with no attractors. If S is not an orbit then by 



definition 5.7 for some Si € S it must be the case that either 1) there is some time in the 
future after which S{ does not get visited or 2) some state outside S gets visited. Let n be 
|S|. For any n, case (1) implies that any orbit must be smaller than n and case (2) implies 
that there must be at n + 1 states in the system. For n = 1 it is not possible for the orbit to 
be smaller so any orbit must contain at least n + 1 = 2 states. By induction on n it must be 
the case that if there are no orbits of size l<ra<iV(n = ./Vis the whole system) then any 
orbit must be of size N + 1 which is impossible. That contradicts the assumption that there 
exists a system with no attractors, so every system must have at least one attractor. □ 

Definition 5.10. Those states from which the system will eventually move into a specific 
attractor are said to be in that attractor's basin of attraction. The basin of A4 or B(Aj) is 
a set of states S such that|£] 



3h > P{s t+h = A\s t £ S) = 1 



Some systems may spend a great deal of time in a basin of attraction before reaching 
the attractor located within it thus making system behavior in the basin similar to an orbit 
itself (also note for the discussion of robust sets below) . In such cases it is sometimes helpful 
to utilize the following property to describe and make inferences about system behavior. 

Observation 5.9. Once in a basin of attraction the system can never leave it. 

WhP(s t+h eB\s t eB) = l 

Definition 5.11. The support of a state (also known as its in- component) is the set of 
states which have a path to it. The support of Si or S(5j) is the set of states such that 

Vj Sj € S(Si) (SjSi). 

6 Because the state space is finite and there is a limit to the granularity of the probability measures this 
definition suffices without needing to take h — » 00. See previous footnote for more details. 
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We can expand this definition to the support of a set of states S as the union of the 
supports of the members of S. Some facts relating these features of system dynamics are 
clear from the above definitions. 

Observation 5.10. An attractor is a subset of its basin of attraction, and an attractor's 
basin of attraction is a subset of its support. 

Ai C B(Ai) C §(Ai) 

Observation 5.11. The equilibrium may be the only member of either its basin or support, 
but if it is the only member of its support then it is disconnected from the rest of the graph 
(e.g. Sis in figure^. 



Figure 3: Attractors, Basins of Attraction, and Support 




The indeterminate states of a system, ones that are not members of a basin of attraction, 
convey a wealth information about the system's dynamics and its future states. Recall that 
the whole system may be a single orbit and there may be no indeterminate states. But 
if there are multiple attractors, then the indeterminate states are the ones in multiple 
attractors' supports. 

Definition 5.12. The overlap of a collection of states (whether attractors or not) is the 
set of states in all of their in-components (i.e. the intersection of supports). The overlap of 
{Si, . . . , Sj}, written £l(Si, . . . , Sj), is the set of states in 

n s w 

Basins of attraction can only contain one equilibrium state or orbit and hence the basins 
for two different attractors cannot overlap. Supports of different collections of attractors 
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Figure 4: Supports and Their Overlap 




may or may not have sets of overlapping states. The overlap states are of interest because 
these are the states with positive probabilities for ending up in each of the attractors for 
which the supports are overlapping. 

Observation 5.12. If no attractors' supports overlap then every attractor's support is just 
its basin of attraction and the system has a deterministic outcome. 

Example 5.1. Models referred to as dynamical systems models typically use sets of differen- 
tial equations and are typically fully deterministic because the map from x to f{x) is always 
a function in the strict sense. Because the dynamics are produced from these functions, 
every initial condition is mapped to a particular equilibrium state. Certain parameterized 
systems allow changes in their state maps that can change the number, location, and/or 
"strength" of equilibria. But for any given value of those parameters, each initial value still 
has one possible outcome. Many systems can be usefully modeled with such fully determin- 
istic systems, but in this paper we are mostly concerned with the non-deterministic parts 
of systems because that is where the critical points occur (see next section). 

Definition 5.13. A state's out-degree is the number of distinct successor states (states that 
may be immediate transitioned into). The out-degree k{ of state Si equals 

\{S r .P( s t+1 = S j \s t = S i )>0}\ 

Sk will be used to denote a neighboring state and Sk the set of neighboring states. 

Definition 5.14. The number of states that can transition into a state is its in-degree. 

\{Sj:P( s t+1 = Si\s t = Sj) > 0}\ 
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The in-degree measure will be rarely used in what follows (except for algorithms utilizing 
a reversed Markov model subgraph) and will not need its own symbol. Because of this 
asymmetry the term 'degree' will refer to a state's out-degree unless otherwise noted. 

Definition 5.15. The reach of a state (also called its out- component) is the set of states 
that the system may enter by following some sequence of transitions; i.e. all possible future 
states given an initial state. The reach of Si or R(Sj) is the set of SjS such that 

3h > P{s t+h = Sj\s t = Si) >0 

Theorem 5.13. Every successor state's reach is less than or equal to the intial state's 
reach. 

Vi,i^s)=H|R(Si)|| > l|R(^-)ll 



Figure 5: A State with a Large Reach 




Theorem 5.14. Sj is in the reach of Si if and only if there exists at least one path from 
Si to Sj. 

Sj £ R(S'j) 44> 3SiSj 

This theorem, which can be used as an alternate definition of reach, follows from the 
definitions of path and reach. 

Corollary 5.15. An obvious corollary of the definitions of basin and reach is that if the 
reach of a state Si includes only one attractor then Si must be in that attractor's basin of 
attraction 

3\Ai e R(Si) ^S t e B(^). 

Observation 5.16. An attractor state's reach is just the states within the attractor; an 
equilibrium's reach is itself. 
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Figure 6: Two States with Small Reach 




Proof. For all transitions Si Sj it must be the case that Sj £ R(Si) from the definition of 
reach since h = 1 satisfies 3h P(st+h = Sj\st = Si) > 0. Furthermore every S g in the reach 
of Sj is also in the reach of Si because for whatever h makes it true that S g G H(Sj), h + 1 
makes it true for Si- To achieve the inequality it suffices for there to be at least one state 
in R(S'i) not in H(Sj). It is prima facie obvious that it is possible for 3S g such that Si S g 
and $Sj S g . □ 



Theorem 5.13 generalizes to all paths (which is just a sequence of transitions) so that 
reach never increases as the systems transitions along any path. This property relies on the 
fact that the transition structure is fixed for the Markov models used in this paper; future 
work will relax this requirement and the theorem does not necessarily hold for models with 
changing dynamics. 

A strongly connected component of a directed network is a set of vertices such that there 
is a path from every vertex in the set to every vertex in the set (including itself). We will 
find the same concept useful, but this paper adopts a different name for it. 

Definition 5.16. A core of a set is a subset wherein every member of the subset is in the 
reach of every member of the subset. The core of some set S is written Cs and is a subset 
satisfying the condition 

n n % e r ^ 

Some sets will have multiple cores - the set of S's cores can be called S's mantle. 

Observation 5.17. Every cycle within S is (at least part of) a core and every state in a 
core is in at least one cycle. 

Observation 5.18. Every state in a core has the same reach. 
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Figure 7: The Cores of an Arbitrary Set 




The states on the boundary of a set are a useful set of states to identify. 

Definition 5.17. The perimeter of a set, IP(S), is a collection of those states in the set that 
may transition to states outside the set. That is, S such that 

P(s t+1 S\s t G S) > 
Figure 8: The Perimeter States of an Arbitrary Set 




In keeping with the core and mantle analogy, the perimeter states of the mantle of S 
will be referred to as S's crust. Perimeter states themselves, without further specification, 
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describe one commonly deployed (though weak) concept of tipping points, although we will 
see in the next section that specifying different base sets produces different types of tips. 

In the next section we apply the above definitions in different combinations and differ- 
ent contexts to identify various system behaviors. Most extant systems analysis focuses on 
equilibria, but a lot of interesting behavior happens away from equilibrium. In the indeter- 
minate states of a system we cannot know precisely which states the system will reach or 
which state it will be in at a given time in the future, we only know probability distributions 
over the future states. But by understanding a system's behavior we might know whether 
some particular change facilitates a specific outcome or path through the dynamic - this 
may be helpful information. Discerning these sorts of facts about system dynamics can 
increases one's information about the system (in both the technical and colloquial senses). 
Considerations such as this one are the building blocks of the formal theory of tipping 
points, robustness, and related phenomena immediately to follow. 



6 Tipping Phenomena and Related Concepts 

Using Markov models and the states and sets defined above as a springboard, this section 
defines and briefly describes several terms related to the concept (or more to the point, 
concepts) of tipping points. Critical phenomena and tipping points of various kinds share 
the defining feature that (for whatever reason) behavior is different before and after some 
transition. Behavior in this analysis is just the properties of systems dynamics. There are, 
of course, many ways in which the properties of system dynamics can differ and each way 
is a different kind of tipping phenomenon. 



6.1 Levers 

Recalling that state changes occur if and only if there is a change in some aspect of the 



initial state (see corollary 4.1 1, our analysis of tipping phenomena starts with state aspects. 

Definition 6.1. The levers of a state are the aspects of a state such that a change in those 
aspects is sufficient to change the system's state. The levers of Si, denoted L(Si), is 

k Q 

U U x Hi) + x m- 
j=i h=i 

So given a state in the Markov model, the levers are those aspects of the state that 
are different in any neighboring state and each such Xh is a distinct lever. In some cases 
neighboring states will differ by more than one aspect. In those cases the respective element 
of the set L{Si) will be a list of all the aspects that need to change as one lever. 

Definition 6.2. A lever point is a transition resulting from a change in a particular aspect 
(or set of aspects). An aspect's lever points is the collection of transitions that a change 
in that aspect (or those aspects) alone generates. The lever points of X^ is the set of 
transitions created by 

E 

U X h(i) + X h(j) 
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Levers and lever points work complement arily: for levers we pick a state and find the 
aspects that change and for lever points we pick the aspect and find the state changes it 
produces. 

It is occasionally helpful to refer to the aspect change(s) that generate a specific tran- 
sition. 

Definition 6.3. L(Si Sj) symbolizes the lever set of Si Sj: the aspect or aspects that differ 
between Si and Sj. 

In some applications we will be interested in how many aspects change for a transition. 

Definition 6.4. The magnitude of the lever set of a specific transitions is \L(S{ Sj)\. 

Though levers as they are defined here do not depend on the ability to control that 
aspect, the choice of 'lever' for this concept is motivated by the realization that in some 
models control of some aspects is available. One may be performing a tipping points analysis 
precisely because one is choosing levers to bring about one state versus another (or agents 
within the model may be choosing). 

Example 6.1. Imagine a model wherein each aspect is a variable representing some part 
of a policy (e.g. amount of money spent on each line item). Each aspect change has an 
associated cost (legal, bureaucratic, time, etc.). The modeler may be trying to determine 
the lowest cost, feasible route from the current policy to some desired policy; or perhaps to 
determine how far policy can be changed on a specific budget. The cumulative magnitudes 
of lever sets along a path may adequately approximate such a cost measure. In general the 
sum of the magnitudes along a path is a rough measure of how difficult it is for the system 
to behave that way. Techniques from circuit design applied to the Markov model may be 
gainfully applied to such models. 

In some contexts we may wish to know how much change an aspect is responsible for 
across the system's dynamics. 

Definition 6.5. The strength of a lever is the sum of the probabilities of all transitions 
that result from changing that lever. The strength of Xh is equal to 

E 

/, P ( S i S j\ X h(i) X h(j))- 
Si Sj 

This measure is not scale-free since the sum depends on the number of transitions in 
the Markov model, but it is useful for comparing levers within a system. The strength 
measure could be used, for example, to determine which aspects to control to maximize (or 
minimize) one's ability to manipulate the system. It could also be associated with a cost of 
letting that aspect vary over time. We will revisit levers below in other forms as they apply 
to other measures of system dynamics. 

6.2 Thresholds 

In some cases we are interested not just in which aspects change through a transition but 
also in the valued of levers at transitions. 

7 Recall that many of the things that can be included as aspects of states are not numeric parameters and 
so what counts as a "value" for that aspect is meant to be interpreted broadly. 
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Definition 6.6. A threshold or threshold point is a particular value for a lever such that 

if the value of the aspect crosses the threshold value it generates a transition. So x is a 
> 

threshold value of S% Sj if 

x h(j) + x and X h{i) = x. 

This definition can be applied mutatis mutandis for a set of values {x} for a lever set 
which can be distinguished by the name threshold line when appropriate. 

If there are multiple states with transitions crossing the same threshold value then 
knowing that information refines our understanding of the lever's role in system dynamics. 
Thus determining the threshold value for one transition is merely a means to the end of 
determining the strength of the levers with that threshold. 

Definition 6.7. The threshold strength of x is the strength of the levers for which x is the 
threshold value: 

E 

^2 p ( S i s j\ x h(j) + x and X h (i) = x). 
Si Sj 

If a particular value for a particular aspect plays a large role in system dynamics then 
crossing that threshold is another oft-used version of "tipping point" behavior. 

These definitions of threshold and threshold strength only require that the end state's 
value be different from the start state's value. In common usage, however, thresholds 
establish different and separate boundary values for ascending and descending values. If a 
threshold only affects system dynamics in one direction then we can determine that from 
the Markov model using the following definitions. 

> 

Definition 6.8. An upper bound threshold of Si Sj is a value x such that 

x h(j) > x and X h ^ = x. 
> 

Definition 6.9. A lower bound threshold of Si Sj is a value x such that 

Xh{j) < x and X h ^ = x. 

The threshold strength measure can be adapted to these ascending and descending 
definitions in the obvious ways. Sets satisfying these definitions can tell us how frequently 
crossing that threshold in that direction acts as a lever. If there are multiple states with 
transitions crossing the same threshold value then knowing that information refines our 
understanding of the lever's role in system dynamics. 

Example 6.2. This general definition admits examples from many different kinds of systems 
and can even apply to parts of systems (such as agents). In Granovetter's model of riot 
spreading jS] we can talk of each agent having its own threshold - the number of rioting 
agents necessary to make each agent join the riot. This is just the same threshold definition 
applied to a lever set where the levers happen to be the same feature of each agent. In 
Granovetter's model the threshold value is the same in both directions. 

We can also talk of thresholds in the properties of the system dynamics that track how 
the system transitions through states. Instead of being a value for an aspect within the 
model, it would be a value for one of the measures defined in this paper. 
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Example 6.3. The following might be the case for some system: once the energy level of 
the current state drops below three the system is at most three transitions away from being 
in an attractor. Though having an energy level is not part of the system that the Markov 
model represents we can associate this property of system dynamics with each state of 
the system as if it were one of its possible levers. Then we can explore the relations of 
specific values of this property of system dynamics to its other dynamics. Relating values 
of properties of system dynamics back to aspects within the model will also provide useful 
information in many cases. 



6.3 Critical Behavior 

In some system analyses the property of interest is what is available for the future ... in 
the most general terms. If one does not know much a system's dynamics then even knowing 
how many states could potentially be transitioned to provides an informational benefit. The 
measures below become increasingly refined and detailed, but we start with some simple 
measures that may suffice for some applications. 

Definition 6.10. A state's stretch is the number of states in its reach. So the stretch of 
Si equals 

\K(Si)\. 

Definition 6.11. A system dynamic (i.e. a particular state transition) is considered critical 

> 

behavior if and only if it produces a decrease in stretch; that is, critical behavior is any Si Sj 
such that 

\R(S l )\ > |R(^-)|. 

In addition to identifying the transitions that limit the system's future states, we can 
also measure how critical the transition is. Subtracting the end state's stretch from the start 
state's stretch provides such a measure, but it is not scale-free^] and so cannot be readily 
compared across different systems. We can normalize the stretch difference with the size of 
the system to which it is being applied to produce a percentage measure. 

Definition 6.12. The stretch-gap of a transition is the change in the percent of the total 
number of states that can be reached. This quantity equals 

mSi)\ |R(5j)| 
N N ' 

Because this measure includes the total number of states in the system it clearly is 
not scale-free either. However despite this limitation it does provide information about the 
system's future and is an intuitive way to compare transitions within the same system - 



even at different resolutions. As example 6.4 below demonstrates the stretch-gap reports 



how much of the system's state space is cut off by each transition and this information could 
be used, for example, to manipulate system dynamics to prolong system longevity. We also 
have an alternative, fully scale-free, measure of the drop in reach across a transition. 



8 It is not scale-free because both the range of values and the particular value for this measure depends 
on the total size of the system. 
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Definition 6.13. A transition's criticality is one minus the ratio of the start and end 

> 

states' stretch. The criticality of Si Sj equals 



1 



|R(g 3 -)l 

msi)\' 



Recall from theorem 5.13 that from any initial starting point, as the system transitions 
through its states the sizes of the states' reach are monotonically decreasing. As a result of 
that theorem we have the following corollary regarding the range of values for the ratio of 
reaches. 



Corollary 6.1. A transition's criticality will be between zero and one. 



for transition S{ Sj. From theorem 



5.13 



a < b. 



Proof. Let a = |R(5j)| and b = |R(5,; 
a = b produces | = 1 which yields a criticality of zero. For a < b we can decrease a or 
increase b to find the other bound, but since a and b are natural numbers increasing b is 
the better approach. Using a well-known mathematical fact suffices for finding the other 
bound: Va lim^oo f = 0. □ 

Observation 6.2. Transitions within a cycle (which includes self-transitions) always have 
zero criticality and zero stretch- gap. 



This observation follows from observations 15.171 and 15.181 and the definition of a core. 
The concept of criticality agrees with this measure insofar as any transition that has no 
affect on what states may be visited in the future should not be a critical transition. 



Figure 9: Stretch-Gap and Criticality Measures 
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Example 6.4. The system represented as figure [9] has thirty-three states in total. Each one 
is color-coded by its stretch. Compare the patterns in color to the attractors, basins, and 
support in figure [3] and the overlap in figure [4j Stretch alone, though a rather simplistic 
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measure, works decently to partition the system dynamics into regions of similar behavior. 
Stretch-gap performs well as a discriminator that groups states into these regions in a way 
similar to spectral analysis for detecting community structure in networks [5]. To wit, 
stretch drops between zero and four states within any basin or overlap, but drops four to 
eighteen states crossing a boundary (in this example). This is not completely reliable, of 
course, but for many systems this simple technique may provide all the information required; 
and it may be the best one can do with available data. 

S21 has a stretch of 21, S25 has a stretch of 6, and S28 has a stretch of 2. There are 
33 states in this system so the stretch-gaps of S21 5*25 and S25 5*28 are 45.45% and 12.12% 
respectively. That means that 45.45% fewer of the system's states can be reached after 
the .S25 S28 transition. We can also use this to determine the stretch-gap of S21 S28 as 
57.58% regardless of the particular path taken. Only the start and end states' stretches are 
necessary to calculate this, but the result is always equal to the sum of the stretch gaps of 
each transition taken. 

Let's compare these figures to the criticality of the same transitions. The criticality of 

> > 

S21 S25 is 0.714 and the criticality of S25 S28 is 0.667. That means that the system only 
has 71.5% of the possible future states in state S25 as it did in S21. A composite measure 
is also possible for the criticality of S21 S^g- It can be calculated just using the start and 
end states' stretches, using the standard percentage of a percentage of a percentage . . . 
calculation. So the criticality of S^h 8 = 0.714 + 0.667 • (1 - 0.714) = 0.905. 

These measures above are intended to be just rough measures useful in certain limited 
contexts and when information about the system is limited. For starters, these measures 
only consider only the structure of the Markov models, not the probabilities. Also, they 
apply to transitions rather than states. 

Definition 6.14. The criticality of a state is the probabilistically weighted sum of the 
criticality of all the transitions from that state. So to find the criticality of Si we calculate 



5> 



msj)\ 

|R(^)| 



where by convention that is the sum over SVs neighbors 



in 



Because by definition 4.3 the sum of the probabilities sum to one, state criticality will 
also be a scale-free measure with values between zero and one. All these criticality measures 
quantify the constriction of future possibilities on a state-by-state basis which is useful if 
we want "to keep our options open" . As we will see later that is sometimes exactly what we 
want to measure, but sometimes we will want to measure system dynamics with reference to 
some particular features and that is what the following definitions for tipping points allow 
us to measure. 

9 The value equals the iterated sum of the previous transition's criticality and the product of the transition 
criticality with the previous transition's criticality's complement 

10 In this case it does not matter whether the sum is limited to span over neighbors or all the vertices 
because Py = for Sj that are not neighbors. This convention will be used throughout - including cases 
where limiting an operation to neighbors matters. 
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6.3.1 Critical Levers 



As a refinement of levers from definition 6.1 we can apply the lever concept to critical states 



to identify another feature of system dynamics. 

Definition 6.15. A state has a critical lever if a change in that aspect (or those aspects) 
of the state will reduce the reach. 

This merely combines the concept of a lever with the concept of critical behavior (defini- 
tion 6.11 ). By looking more deeply at the aspects driving the state changes and calculating 
the magnitude and strength of different critical levers we can gain a better understanding 
of how microfeatures generate the macrobehavior of the model. 



6.4 Tipping Behavior 

As mentioned in the section introduction, the common feature of the measures in this sec- 
tion is that some states or transitions mark a shift in the properties of a system's dynamics. 
For the criticality measures above the difference was the number of reachable states. The 
following measures generalize to any sets distinguished by a chosen characteristic. Given 
states exhaustively compartmentalized by the property (or properties) of interest the fol- 
lowing techniques can find where shifts occur and measure their magnitude. 



6.4.1 Tipping Points 

For some models we are interested in the achievement of a particular state (e.g. an equi- 
librium) or a particular system behavior (e.g. a path linking two states). We denote the 
particular state (or set) of interest as the reference state (or reference set). Below we will 
see examples of specific reference states (e.g. attractors and functional states) but first the 
general case. There are many ways in which behavior may change with respect to a reference 
state or set (e.g. probability of reaching it, probability of returning to it, or probability of 
visiting an intermediate state): each property may partition the states into different equiv- 
alence classes (groups with the same value of the property). It is the movement between 
equivalence classes that counts as tipping behavior. 

Definition 6.16. A tipping point is a state which is in the perimeter of an equivalence 
class for some property. 

Recall from definition |5.17| that perimeter states are those from which the system's 
dynamics can leave the specified set. Because the sets here are determined by the properties 
of system behavior leaving a set implies a change in that behavioral property - and that is 
a tip. This definition does not preclude that the system could tip back into a previously 
visited set: that possibility depends on what property is establishing the equivalence classes. 

Example 6.5. A climate change model that relates the CO2 content of the atmosphere 
to global temperature may have states that are grouped together according to a shared 
property of those states (e.g. sea level, precipitation, glacial coverage). Due to feedback 
mechanisms in the system it is likely the case that these qualitative features change in 



punctuated equilibria (see also example 7.4) thus producing equivalence classes for some 
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states of the system. Ex hypothesi people can manipulate the level of CO2 to higher or 
lower values. The values at which the property shifts happen may differ for the increasing 
and decreasing directions, but the point is that CO2 levels could raise temperatures to the 
point where glaciers disappear and then later lower past the point where glaciers will form 
again. For some systems behavior can tip out of a equivalence class and then later tip back 
in. Phase transitions in condensed matter physics are another example of reversible tipping 
behavior. So while some have posited that tipping points are points of no return for system 
behavior, that turns out to be true only for certain systems and is not properly part of the 
definition. 

Dynamics of staying, leaving, returning, and avoiding a specified set of states will be 
covered in the section below on robustness. Here we continue with ways to quantify changes 
in what is possible for system dynamics for different states and transitions. These measures 
apply for any reference state or reference set, but for convenience and intuition pumping the 
following presentation will adopt the notation of attractor (Ai) for a reference state and set 
and A for a collection of reference states. Recall from definition |5 .9| that attractors may be 
equilibria or orbits and both possibilities were symbolized with A{ and treated as singular. 
That convention will be continued here. A is a collection of independent reference states 
and sets each of which satisfies a property while A{ may be a set of states that collectively 
satisfies a particular dynamical property (such as an orbit as a whole satisfies the dynamical 
property of an equilibrium) . 

Definition 6.17. The energy level of a state is the number of reference states within its 
reach. We write this as E{Si) and it equals 

A 

|(J^GR(Si)| 

Energy level quantities partition the system's states into equivalence classes. 

Definition 6.18. The equivalence class mapping created by states' energy levels is called 
the system's energy plateaus. Each energy plateau is a set 

JV 

\jE(S i )=E(S j ) 

hi 

Definition 6.19. The change in energy across a transition is called an energy precipice or 
energy drop. We can measure the magnitude of an energy precipice in the obvious way: 

AE{S~S j ) = E(Si) - E(Sj) 
Theorem 6.3. An energy precipice is never negative: AE(S{ Sj) > 0. 
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Figure 10: Energy Plateaus 




Proof. From definition 6.17 the energy level of any state Si is the number of attractors 
in R(S'j). By theorem 



5.13 



for any Si Sj R(Sj) C R(iSj). This decreasing reach property 
implies 

A A 

\\jAi€ R(S,)I < I [jA G E(Sj) < E(Si) 

Since the end state of a transition always has a lower or equal energy level, E{Si) — E(Sj) 
is always greater than or equal to zero. □ 

We now can measure the degree to which a state is likely to be the site of a tip (in a 



similar fashion to definition 6.14 of state criticality above). 



Definition 6.20. The tippiness of a state is the probabilistically weighted proportional 
drops in energy of its immediate successors: 



1 



k 
3=1 



EjSj) 
E(Si) 



Theorem 6.4. Tippiness ranges from zero to one. 

Proof. The lower bound occurs when all neighbors can reach the same number of refer ence 

In this case tippiness equals 1 — Y^j=i Pij • 1 = by theorem 



ii 



4.3 



states: VkE(Si) = E(Sk] 
By theorem |6.3| £'(5i) ^ EXSk). When E(Si) > E(Sk) the upper bound o ccur s when a state 



has every attractor and only attractors as neighbors. Again by theorem 

ive an 

is |A| so Si's tippiness is 1 — J2j=i 



4.3 



ik 



1. 



: Si in this case 



Attractors by definition 5.9 have an energy level of one and the energy level o: : 

m = 1 — r^T. Thus the upper bound of Sj's tippiness 
goes to 1 as |A| — > oo. □ 



1 Recall the convention that k denotes the degree of a state and Sk is a neighboring state. 
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Note that tippiness uses the ratio of energies rather than the difference; this makes 
tippiness a dimensionless metric and thus comparable across any state or system. Sometimes 
one will be more interested in minimizing the magnitude of energy drops, or avoiding states 
with the highest expected magnitude of energy drops, which have obvious formulations 
given the above definitions. 



6.4.2 Tipping Levers 



As another refinement of levers from definition 6.1 we can apply the lever concept to tipping 



points to relate tips to the individual aspect changes that drive them. 

Definition 6.21. A state has a tipping lever with respect to some specified set of states if 
a change in that aspect (or those aspects) of the state will take the system out of that set 
of states. 



This merely combines the concept of a lever with the general concept of tipping behavior. 
So while every state accept equilibria has levers, only perimeter states have critical levers. 
Identifying the tipping levers of certain sets of states is precisely what we'd like a "tipping 
point" analysis to reveal because it is just the aspects of a tipping point that actually change 
when the system tips out of a set of states. These ideas are further refined in the analysis 
of robustness and related concepts below. 



7 Robustness-Related Measures 

This section will use the Markov model framework provided above to establish formal 
definitions of several related concepts: robust, sustainable, resilient, recoverable, stable, 
and static; as well as their counterparts: susceptible, vulnerable, fragile, and collapsible. 
As before, it is unlikely that any mathematically precise definition will maintain all the 
nuances of the full concept sharing the same name. Furthermore, existing definitions and 
formal treatments of the same concepts or that use the same terms risk distracting from or 
confusing the thrusts of this research. What is more important than the terms used is that 
the definition is useful and we can easily refer to it, though some care has been spent on 
finding the closest word to the provided definition. 

Adding to the ambiguous and often synonymous usage of these terms are the conceptual 
questions that arise in considering their dispositional nature. Dispositional properties are 
philosophically troubling for many reasons but the philosophical troubles will not interfere 
with their definition and ascription here (mostly these stem from the question of whether 
their subjunctive conditional status distinguishes them from categorical properties). I men- 
tion this here because I want to hint that in addition to the obvious and direct application 
of this methodology to improve the performance capabilities of systems, it may also pro- 
duce insights into the nature of dispositional properties in general. This analysis reveals 
how these particular dispositional properties are behavioral in nature and emerge from the 
microbehavior of the system components. The philosophical issues will be addressed in 
separate work (see future work subsection below), but it may be interesting to the reader 
to consider how to apply the following methodology to investigate other dispositional prop- 
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erties such as soluble, malleable, affordable, and differentiate them from other types of 
properties with the much sought after necessary and sufficient conditions. 



7.1 Stable, Static, and Turbulent 

The measures in this first set are conceptually simple with intuitive mathematical definitions 
and straightforward algorithms. They nevertheless identify important features of system 
dynamics and act as building blocks for more sophisticated measures. 

Definition 7.1. A state's stability is how likely that state is to self-transition. S^s stability 



is 



P(s t +i = Si\s t = Si). 



While this may seems a trivial property, it is consistent with a useful distinction from 
system dynamics: the difference between stable and unstable equilibria. Due to the resolu- 
tion of the Markov model's states, an attractor state will include a neighborhood of aspect 
values around the equilibrium point values. Thus exit behavior from the attractor node 
includes the response to small perturbations to (or variations around) the equilibrium point 
values. Stable states will tend to stay within this neighborhood and this is reflected in a 
high self transition probability value. Since values that are nearby an unstable equilibrium 
but not exactly on the equilibrium point values will tend to move away from the equilibrium 
values, we would see this reflected in low self-transition probabilities. These results exactly 



match attributions of stability and instability in the Markov model via definition 7.1 
We can extend stability to apply to sets of states in the obvious way. 

Definition 7.2. The stability of a set is the probability that the system will not transition 
out of the set given that the system starts within the set. We calculate this as the average 
of the individual states' exit probabilities, so set stability is 



This is a crude measure because is doesn't properly reflect the probability of staying 
within the set over time, it only looks one time period ahead. A more sophisticated notion 



of staying within a set of states is presented by definition 7.6 below of sustainability, but in 
some cases (discussed in that subsection) the two measures generate the same value. 

The word 'static' is often used to indicate a lack of dynamics in a system, and that is 
the sense attached to the following formal definition. Recalling that self-transitions can be 
interpreted as a lack of transition it aggregates the lack of transitions among states. 

Definition 7.3. The degree to which a set is static is the average of the states' stability 
values: 

— ^2 p ( s t+i = Si\s t = Si) 
' ' s,es 

This definition, though simple, captures how likely a system is to be in the same state 
for consecutive time steps in a way that is comparable across sets and systems with different 
numbers of states. What this definition fails to capture is that sets with equilibria will spend 
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an infinite amount of time in them whereas sets lacking equilibria will continue to transition 
for eternity (even if that's within an attractor); and yet because this measure uses average 
stability it is easy to construct cases where an equilibrating systems has a lower static level 
on the given definition. 

Static and stable set measurements are similar in their calculation but distinct in their 
sense. Set stability is a measurement of lack of change, but it is a lack of change out of a 
set (though it ignores dynamics that stay with in the set). It is therefore only applicable if 
the set chosen is smaller than the whole system. Staticness can apply to the whole system 
and is useful for comparing systems' overall level of dynamism. 

Theorem 7.1. If S = Si (i.e. a set with one state) then the static measurement equals the 
stability measurement. 

This theorem clearly follows from the fact that the sum of transitions staying within a 
set equals the sum of self-transitions for a set of one state. Also in this case set stability 
naturally equals state stability because the set is a state. 

Theorem 7.2. For any set, the set stability measure is always greater than or equal to the 
level of staticness. 

Proof. For any given Si 6 S, the set stability measure is 

k 

P(s t+ i e S\s t = Si) =J2 p (sTSj\Sj e S) + P(S~S i ) 

3=1 

The probability of transferring to another state in S, X^=i P(&i e S) is greater than 

J ► 

or equal to zero. If that equals zero then S^s contribution to set stability becomes P(Si Si) 

which is equal to Si's contribution to the static measure. If P(Si Sj\Sj £ S) > for any 
Si £ S then S's set stability is greater than its degree of being static. □ 

On the other end of the spectrum as stability and staticness are measures of how likely 
the system is to change states. Because the above measures are defined in terms of proba- 
bilities, most simple measures of the presence of dynamics can be calculated as one minus 
the appropriate measure above. There is one additional simple measure to present here; it 
is a rough measure of how predictable state changes are. 

Definition 7.4. The turbulence of a set is the average percentage of states that its states 
can transition into. We can calculate S's turbulence with the average ratio of each state's 
degree to the number of states in S: 

1 x - k 
|S| ^ |S| 

This measure ranges from zero to one where the zero case occurs as |S| — > oo and a 
turbulence of one means that the set is fully connected (including self-transitions for each 
state). The idea is that when each state has only a few possible transitions then there are far 
fewer possible paths through the system dynamics. If each state can transition into many 
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others then, like with the common usage of 'turbulent', there is a great deal of uncertainty 
regarding the path that a series of transitions will take. Plotting the degree distribution 
would reveal a set's (which might be the whole system or just a portion) turbulence profile. 
If one were to find something like a power-law distribution (where a few states have many 
transitions and most have just a few transitions) the high-degree states would seem to satisfy 
yet another concept of tipping behavior. Combining turbulence profiling with (for example) 
the identification of perimeter states could be used to classify systems by the dynamical 
properties (see future work section for more details). 

Though the turbulence measure may provide sufficient information in many systems, it 
fails to differentiate the effects of high and low probability transitions. Transition weights 
clearly play a role in determine how confident one can be that a particular trajectory will 
be taken rather than another. For example, if all but one of a state's transitions have very 
small probabilities associated with them then the set should be considerable less turbulent 
than if all the transitions are equally probable. 

Definition 7.5. As a refinement of turbulence, weighted turbulence of the state Si equals 
zero if k = 1 and for k > 1 can be calculated as 



E 1 ' 1 

3=1 



(P(Si S 3 ) - -) 2 



Because by definition 4.3 the sum of exit probabilities sum to one, the average of the 
exit probabilities is ^ regardless of the number and their individual weights. The innermost 
component of this calculation, therefore, finds the difference between each transition and 
the average weight and squares it. Squaring has the dual effect of producing an absolute 
value and intensifying differences; the intensification is not crucial and is merely adopted 
by convention. Because turbulence is maximal when each weight is equal, we subtract 



the differences from one to calculate each state's turbulence. To determine the weighted 



turbulence of a set we simply average each included state's weighted turbulence 



7.2 Sustainable and Susceptible 

In common parlance something is sustainable if it can perpetually maintain its operation, 
function, or existence. It is often used in connection to environmental considerations such 
as whether humans are using up resources faster than they can be replenished or to the 
ecological question of whether population dynamics will drive any species to extinction. 
Political institutions, academic reading groups, pools of workers, and any other system that 
undergoes inflows and outflows of its parts and might collapse or fail is a potential subject 
for sustainability considerations. 

Roughly speaking, for this analysis a set of states is sustainable if the system can stay 
within that set of states. There are multiple ways to calculate a measure of this sort and 
each reports a slightly different concept of sustainability. As a crude approximation to the 
long-term sustainability we can find the cumulative sum of the t th power of the set stability 

12 The reason for the separation of the value for the k = 1 case is that the definition produces a value of 
one instead of zero. This is an artifact of the fact that if there is only one edge then all the edges have a 
weight equal to the average weight - and that is the case that produces maximal turbulence for all other ks. 
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measure from definition 7.2 up to some sufficiently large T (see observation 7.3 below). We 
could call such a measure naive sustainability and identify conditions for its appropriate 
application, but instead we will move on to a more sophisticated measure. 

The previous measure is crude because within a set there may be (for example) heavily 
weighted cycles such that if the system starts in one of the cycle-states it is very likely to 
go around the cycle for a long period. To properly account for this, while still remaining 
agnostic over which state of S the system starts in, we calculate a refined sustainability 
measure. 

Definition 7.6. The sustainability of S is the average cumulative long-term probability 
density of future states that remain in the set starting from each state in the set 
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istEE p ( s '+i gS I s * gS ) 

1 1 SiGS t=0 

Observation 7.3. If the chosen set does not contain an attractor then this calculation is 
unproblematic because some probability density "escapes" the set each iteration and there 
exists some time T after which the remaining probability density in each state of S is less 
than any arbitrarily chosen minimum resolution. 

Sustainability measurements are therefore only appropriate for sets that do not include 
attractors. If an application to sets including attractors were deemed useful then we could 
separate out the basin(s) of the attractor(s) from the other states and apply the sustainabil- 
ity measure above to the remaining states of the set. It is still not clear how to recombine 
the two subsets into a single measure or how to cope with epistemic barriers to know- 
ing whether a set contains an attractor before running the analysis and thus whether this 
would be necessary. Because sustainability is a cumulative measure the calculation will 
not produce a probability. But because the cumulative sum is divided by the size of S it 
is normalized and comparable across differently sized sets. What we uncover through this 
process is a measure of the expectation over time that the system will stay in the set given 
that the system starts somewhere in it. 

Example 7.1. If S is chosen to be an energy plateau then all exit transitions are one-way. 
If there are no cycles in S then the probability mass will quickly dissipate from within S 
yielding a very low sustainability measure. If there is at least one cycle then there is a 
chance that the system will stay within the set indefinitely, but since that cycle cannot be 
an attractor the system will leave the set in expectation. The stronger the weights of the 
transitions among the cycle states the greater the sustainability measure. 

The energy plateau application is especially helpful for the "keep our options open" 
mindset and where each equilibria is a different form of system failure (e.g. for dissipative 
structures). It can even be useful to calculate the sustainability of a basin of attraction 



13 The algorithm for calculating sustainability starts with a vector of ones for the states in the set and 
zeros for states out of the set. It then iterativ ely a pplies the this vector to the whole adjacently matrix taken 



to the t th power up to t — T (see observation 7.31. This is done each time to clear out the probability mass 
outside the set so that it can't return. The result is the sum of the resulting vectors for the states in S each 
step. Usually algorithms are been banished to the appendix, but understanding this calculation is likely to 



make understanding definition 7.7 of susceptibility much clearer 
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Figure 11: Sustainability Measures for Two Energy Plateaus 




(excluding the attractor itself) - which is also an energy plateau. The system may exhibit 
interesting and long-lived behavior within a basin of attraction that may reveal much more 
about the processes affecting a system than just which attractor it is likely to end up 
in. Time to equilibria may be on the galactic time-scale and knowing that will alter our 
interpretation of the system's characteristics. 

The term 'susceptible' is typically followed by 'to' and an indication of what the thing 
is susceptible to. I preserve that usage with the measure presented here. We will talk of 
sets being susceptible and sets can be defined according to different properties for different 
applications. States are what sets are susceptible to. This may sound odd, but the prob- 
ability of transitioning out of a set depends on which state within the set the system is 
currently in. So the characteristic represented by staying within a set risks being lost to a 
degree contingent upon the state. 

Definition 7.7. The degree to which S is susceptible to Si is how much more (or less) likely 
it is to transition out of S conditional on it being in a particular state Si of S compared to 
the sustainability of S overall. 

T 

^^P(st+i G S\st £ S and so = Si) — sustainability of S 
t=i 

Given this definition we can see that a positive susceptibility means a lower probability 
to stay within S. 

We can also determine and measure the set's susceptibility to the lever points of an 



aspect. Recall from definition 6.2 that the lever points of an aspect are all those transitions 



that result from a change in that aspect. We can calculate the susceptibility of S to a 
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collection of lever points as 

T E 
^P(s t+ i € S\s t € S and sjst G [J / 



Example 7.2. Sustainable/susceptibility analysis can be used to help systems maintain a 
performance level. We can take the set to be a contiguous collection of states that count as 
functional in some system: such as all the configurations of an airplane that the autopilot 
can manage. For the airplane system some state changes will be exogenous perturbations 
due to environmental factors (wind, rain, pressure, lightening, passenger movement, etc.), 
others will be endogenous control adjustments by either the pilot or the autopilot, and some 
will be a mix. First one would calculate the sustainability of the whole set of autopilot 
capable states. Then one would calculate how susceptibility that set is to each state (or 
smaller collection of states). Using this information the autopilot and/or pilot could select 
actions that minimize susceptibility across the states visited and this means maximizing 
the probability of staying within the set of autopilot capable states. This example can be 
generalized to any case where maintaining functionality is the modeler's goal. 

7.3 Resilient, Fragile, and Recoverable 

Stability, Staticness, and Sustainability are different ways to measure a system's dynamics 
tendency not to leave a state or set; we now turn to measures of returning to a state or set 
once it has been left. 

Definition 7.8. A state's resilience is the cumulative probability of returning to a state 
given that the system starts in that state. The resilience of Si equals 

T 

^2P{s t = Si\s = Si) 
t=l 

It is the sum of the individual probabilities of returning in 1, 2, 3, . . . , T time steps. Be- 
cause the sum of exit probabilities of every state equals one and the probability of traversing 
a path is the product of the states along the path this cumulative sum is always less than 
or equal to one and is a true probability measure. 

Definition 7.9. A state's fragility is a measure of how likely it is that the system will never 
return to that state. This is just one minus the resilience of that state. 

So equilibria have zero fragility and states with no return paths have a fragility of one. 
Measuring the degree of fragility requires the same calculation as measuring the resilience, 
but finding out whether a state is ever revisited is much easier because we can utilize our 
definition of a state's reach. 

Definition 7.10. A state is brittle if and only if it has a fragility value of one (i.e. a 
resilience value of zero). Brittle states are the ones such that 

St R(Si). 
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Figure 12: A System's Brittle States 




Except for the brittle states which have a specific formal significance, the choice of 
whether to use a resilience or fragility measure will depend on which feature the user would 
like to highlight (glass half- full or half-empty) . We can also define the resilience and fragility 
of a set in an analogous way. 

Definition 7.11. Set resilience is the probability that the system will return to a set if the 
initial state of a sequence is within the state. 

T 

t=i 

Though the definition is exactly parallel to the single-state case, the algorithm to cal- 
culate this probability is considerably more difficult. 

Observation 7.4. A few facts about entering and leaving sets will help refine our under- 
standing. 

(i) Transitions exit S through the perimeter states S ou t ofS. 

(ii) Transitions enter S through a set of entry points Sj n o/S. 

(Hi) We can refine the definition of set resilience to Ylt=iP( s t £ Sj n |so £ S out ). 

So to calculate set resilience we need first to find all the paths from each element in 
S ou t to each element in Sj n . In the worst case this can be done in 0(|E| + |N|) time via a 
breadth-first search. Set fragility is one minus set resilience. 

Theorem 7.5. If S is an energy plateau then the resilience of S is zero. 
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Proof. By definition 6.18 an energy plateau contains all the states in the system with the 



same number of attractors in their reach. Any transition out of such a set would be to a 



state with a different energy level and by theorem 6.3 it must be a lower energy level. Also 



by theorem 6.3 no transition can be to a higher energy level. Hence if a system transitions 



out of an energy plateau then it can never transition back into it. If the system cannot 



transition back into the set S then by definition 7.11 S's resilience is zero. □ 



The susceptibility measure determines how sustainability changes depending on the 
specific starting state. We may wish to have a similar measure for resilience that reports 
how likely the system dynamics are to return to a state given that it exits via a particular 
transition. 

Definition 7.12. A transition out of the set is recoverable to the degree that the system will 

> 

return to the set after the transition. S is recoverable from Si Sj to the degree calculated 
by 



P(st G S\Si Sj and Si G S and Sj g" S) 



t=i 



Note that leaving via a particular transition is the same as exiting due to a particular 
lever change. Thus we can uncover the recoverability of a set of lever points (from definition 



6.2 ) for a particular aspect as the average of the recoverability of each transition in it. Also 
note that there may be multiple paths from Si back into each Sj n of S. Each path leading 
from S back into S can be called a recovery path. 

Example 7.3. Continuing with the autopilot example, imagine that there are many known 
points of failure for maintaining autopilot control. Each of these is a transition out of the set 
S via a known lever change. But not all failures are equally as problematic. By calculating 
the recoverability of each of the failure transitions they can be ranked by their seriousness. 
Such a ranking can guide both the pilot in adjusting to the failure and the autopilot to avoid 
it in the first place. Again, the autopilot example can be generalized to the maintenance of 
any system: political regimes, sports clubs, ecosystems, viable crop production, etc. 

7.4 Reliable, Robust, and Vulnerable 

Sustainability measures the likelihood of a system's dynamic's staying in a certain set given 
that it starts within that set and resilience measures how likely it is to return to the set if 
the dynamics leave the set, but these measures do not include the case where the system's 
state starts outside the set and then enters it. When the set of interest is an energy 



plateau resilience is always zero (as shown by theorem 7.5 ) but the set may still receive 
probability mass from parts of the system with higher energy levels. And in cases where 
a non-equilibrium analysis is appropriate we might be comparing different subsets within 
an energy plateau (e.g. the relative probability mass of two cores within the mantle of an 



energy plateau - see example 7.4 below). In this final subsection the above measures will 
culminate in the most inclusive measures of system robustness. 

Before defining the measure that allows for inflow, we first define a measure that com- 
bines the features of sustainability and reliability. 
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Definition 7.13. The reliability of a set is the average cumulative long-term probability 
density over the states in the set given that the system starts within that set. 



1 1 Si&S t=l 

This measure combines the concepts of sustainability and resilience, but it is not just 
the sum of those two measures. Reliability starts the flow in the set and calculates the prob- 
ability of being in each state on each consecutive time step. It does restrict the probability 
mass summation to the specified set, but it tracks probability mass throughout the system. 
The reason that this isn't merely a sum of resilience and sustainability is because when 
combining those two it was not possible to track probability mass that leaves the set, cycles 
back into the set, and then circulates within the set (and maybe even repeats this process). 
With reliability we can reincorporate probability flow that leaves and then re-enters the set. 
A characteristic captured by the chosen set is reliable if it can be maintained or, if lost, can 
be regained. 

Theorem 7.6. If S is an energy plateau then S 's reliability equals S 's sustainability. 



This theorem does not follow directly from theorem 7.5 because there is no direct link 
between resilience and reliability, but the reasoning is the same. Because there cannot be 
any paths leading out of an energy plateau back into it, all the probability mass that S 
gets for the reliability measure is from the initial distribution. Leaving mass never returns 
so that produces an equivalent measure as not counting the returning mass: this is the 



sustainability measure. Hence the sustainability values in figure 11 are also those energy 
plateaus' reliability values. 

Finally we add to the reliability measure the possibility that the system did not start 
in the set, but transitions into it. 

Definition 7.14. The robustness of a set is the average cumulative long-term probability 
density over the states in the set given that the system may start at any state. 

1 1 SiGS t=0 

Robust characteristics not only have high retaining power and recoverability, they also 
draw the system in from states outside the characteristic set. Sets with high robustness 
values are sets that the system's dynamics tends towards. That description makes robust 
sets sound a lot like attr actors; and this is as we would expect. Attractors will typically 
have high robustness measures on account of their perfect sustainability and the fact that 
typically several states will lead into themj^] The attractor-like behavior related to robust 
sets provides interesting and useful insights into many systems' dynamics. 



14 Recall that sustainability is not intended to apply to sets with attractors as parts of them. The measure 
is, however, unproblematic if the set is an attractor (which yields a sustainability of T) or a proper subset 
of an attractor. 
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Example 7.4. Sets that behave like (and are defined as) equilibria in other modeling tech- 
niques may be revealed to be highly robust sets under the current analysis. The phenomena 
of punctuated equilibria describes a system that spends long periods of time in characteristic 
patterns with interspersed and short-lived periods of rapid change. In the Markov model 
representation we might see a mantle of an energy plateau with multiple highly robust cores. 
These cores could have relatively short transition paths among them. Each is a different 
cohesive pattern with larger probabilities of staying in than going out. But because these 
cores are not attractors the system will eventually transition out of them and into the next 
core. 

Example 7.5. One of the foci of complex systems science is the study of the self-maintaining 
(or autopoietic) nature of dissipative structures. Dissipative structures are those where a 
continual flow of energy, matter, or other resource is necessary to maintain system struc- 
ture and performance. Biological systems are like this, constantly changing and adapting to 
maintain functionality, and so are many other complex systems. These are systems where 
there are no equilibria^] or all equilibria are states to be avoided so that the energy level of 
the system remains mostly constant. Some set(s) of states are preferred to others for ex- 
ogenous reasons (functionality, performance, diversity, longevity, or other utility measures) 
and the goal is to maximize time spent in the desired states. The goal might also be to 
maintain some characteristic feature of transient system behavior. The current techniques 
offer new measures of behavior for non-equilibrium analysis. These can be used to embed 
an existing equilibria model into a larger context and/or to push down the level of analysis 
to see what is happening inside an "equilibrium" state. 

Using a definition parallel to that of susceptibility, the following measure calculates how 
much more (or less) likely the system is to be in the set conditional on the dynamics starting 
in a particular state (not necessarily in that set). 

Definition 7.15. A set's vulnerability is the difference in the average long-term probability 
density over the states in the set compared to the density generated by starting in Si 



8 Path Sensitivity in System Dynamics 

This section's status is somewhere between completed work and future work - which I 
suppose makes it work in progress. It has not been prepared to the degree of rigor of the 
previous sections, but there is sufficient material here to provide a strong indicator of how a 
Markov model representation can be used to uncover a variety of measures related to path 
sensitivity. The algorithms for the presented measures (and more) have been prepared, but 
the mathematical and conceptual work needs more smoothing and filling in. It is offered in 
its present form for review, evaluation, and feedback purposes. 

15 There must be at least one attractor per system, but that attractor may be an orbit consisting of every 
state in the system. 




robustness of S 
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Path sensitivity is not a single, well understood and properly denned concept 16 For 
starters, different features of system dynamics can have the path sensitivity property: Out- 
comes can be path sensitive, processes can be path sensitive, measures can be path sen- 
sitive, and paths can be path sensitive. Previous work has focused on explaining why a 
particular system exhibits path sensitivity or how a particular mechanism can generate it, 
but they have not provided general, causally agnostic measures applicable to any system's 
dynamics. What follows is a collection of distinctions and formal definitions for several 
different forms of path sensitivity. And like the above measures of tipping- and robustness- 
related concepts, these measures apply to Markov models representing either observational 
or model-generated data. 



8.1 Path Preclusion 

One type of path sensitivity results when a transition excludes some states from any possible 
future of the system's dynamics. Such an occurrence is closely related to the measures of 
criticality and tipping behavior presented in definitions |6.13| and |6.20| respectively. 

Definition 8.1. Any reduction in the size of the reach across a transition is instance of 

weak path preclusion. The degree of path preclusion of Si Sj is the criticality measure of 

> 

Si Sj . 

Such a definition is likely to be useful in limited number of models but it is conceptually 
intuitive that merely excluding a set of states from the future of a system's dynamics is 
a relevant form of path sensitivity. In applications geared towards preserving, tracking, 
or monitoring some characteristic of the system or its behavior we need a concept that 
accounts for the preclusion of that characteristic. 

Definition 8.2. When there is a reduction in the number of reference states or sets (e.g. 

attractors or specific equivalence classes) that can be reached then this is tipping behavior 

> 

that exhibits strong path preclusion. The strong path preclusion of Si Sj is measured by the 
tippiness of Si Sj. 



Recall from example 6.5 that not being able to return to a state or set was not properly 
part of the definition of tipping behavior. Whether a tip is path preclusive or not marks an 
important feature of the transition. In many cases we will be more interested in whether 
a transition is path preclusive than whether it is tipping out of some characteristic. It is 
this dynamic and its importance for understanding system dynamics that gives tippiness 
its relevance as a measure. 



8.2 Trajectory Forcing 

Some systems have only one long-term outcome (a singular attractor) and some have none 
(when the whole system is an orbit). In either case we might care less about where the 
system goes than how it gets there, i.e. which intermediate states the system realizes 

16 I have named the more general idea that how systems behave changes based on their past 'path sensi- 
tivity' and have reserved the name 'path dependent' for the specific form of path sensitivity highlighted in 
the works of Page and Kollman & Jackson. 
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between two anchor states. We might care about the exact path our dynamics takes through 
the system's states because some states are preferred to others (for exogenous reasons) 
or because they have different dynamical properties (e.g. susceptibility or vulnerability 
measures). Two different tips may include the same reference states but force the system 
dynamics to take different paths to get there. 

Definition 8.3. Trajectory forcing is when a particular transition sends the dynamics down 
a specified sequence of states. The force of an exact path from Si to Sj can be measured 
as the product of the probabilities of all the transitions required to stay that course: 

i 

force of S(Si, . . . , Sj) := P (Sh-i S h \S h -i,S h £ S(Si, Sj)) 

h=l 

Given this general definition it is clear that forcing is relative to the specific set of 
connected states. If, for example, one wanted to maximize the probability of reaching a 
specific equilibrium then calculating the force of each path from the tips of the current core 



to that equilibrium would provide the necessary guidance (see figure 13). The red path 



Figure 13: The Force of Two Paths from S±g to S33 




from S19 to S33 in the figure has a force of 0.01008 and the green path has a force of 0.048. 

> > 

Force is not the same thing as the probability of reaching S33 given S19 S14. and S\g S±q 
respectively; that is calculated by the tippiness of those two transitions with only S33 as 
a reference state. These force measurements are the probabilities of following those exact 
paths to get between those two states. For non-exact paths force can be calculated as the 
sum of the probabilities of the paths that visit each of the specified markers. 

8.3 Path Dependence 

The term "Markovian" means memoryless in the related fields of mathematics where it refers 
to any processes wherein future probabilities of events do not depend on past occurrences 
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(e.g. Poisson processes). The Markov model representation may therefore seem an unlikely 
tool for uncovering dependencies in paths of system dynamics. The conditional probability 
assignments to the transitions imply that the current state is sufficient for knowing the 
probability distributions of future states. But another way to interpret this Markov model 
structure is that it encapsulates the probability distribution of future states if all one knows 
is the current state. It can also be used to track correlations in the specific paths followed. 

Definition 8.4. A state's exit transitions are path dependent if and only if the distribution 
of their probabilities changes conditional on previous states. The degree to which Si's 
transitions are path dependent on a set of historical sets Sh equals 

2 

^(^p(s~s ¥ j )-p(s~s j \s H )) 

i=i 

This definition is very general and is meant to capture all the different ways that prob- 
ability distributions could change due to different types of historical sets (see Page [15] for 
several types of path dependence) . This therefore admits to a refinement for each type of 
historical set dependence: exact path leading to Si, unordered collection of states preceding 
Si, existence of a path S g Si for different S g , stability of Sh, length of Sh, and many others. 
But insofar as each of these conditions can alter the transition probability distribution, their 
degree of path dependence can be measure in the same way. 

Figure 14: Path Dependence of S25 




Example 8.1. Consider the situation depicted in figure [14] both states S23 and S21 transition 
into state S25 which may transition to either S28 or S30 (edges x and y respectively). The 
path dependence of S^s's transitions is revealed through the Markov model when there are 
significant correlations in (say) £23 S25 S28 and S21 S25 5*30- So even though it may be the 
case that P{s t+ i = S 2 8\st = S25) = P(st+i = S 3 o\s t = S21), i.e. P(x) = P(y), it may not be 
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the case that P(x\a) = P(y\a) or that P{x\b) = P{y\b). Assume that the system dynamics 
enter S25 equally often from both S23 and S^i- Given the system at S25 let's assume P{x) = 
P{y) = 0.5. Analyzing the individual time series of data may reveal that P(x\a) = 0.8 and 
P(y\b) = 1.0. So 525 's path dependence on S* 23 = (0.5 - 0.8) 2 + (0.5 - .2) 2 = 0.18. S*2 5 's 
path dependence on S21 = (0.5 — 0.0) 2 + (0.5 — 1.0) 2 = 0.5. Considering the conditional 
probabilities P(x\a) = 0.8 and P(y\b) = 1.0 the relative value of these figures matches 
intuition. 

9 Future Work 

This paper is very much a work in progress and so each definition, measure, theorem, 
algorithm and example is a subject for future work. In addition to bolstering the current 
contents I have several planned avenues for expansion and spin-off projects, some of which 
are outlined in this section. 

9.1 Application to Data Sets and Existing Models 

Good methodology exists as a facilitator to good science, so the first and perhaps most 
important extension of this project is to apply these measures to models within substantive 
research projects. Over the past year of development I have given a few presentations 
and have engaged in many conversations about these techniques and their potential to 
reveal interesting features of system dynamics. The potential collaborative projects that 
resulted from these discussions (outlined below) are in addition to planned applications to 
personal research in the evolution of culture and morality, institutional design, biological 
contagion control, supply chain management, ecological robustness, resource sustainability, 
and various philosophical implications of seeing multiple systems' dynamics as instances of 
the same underlying phenomena. 

Within the University of Michigan several parties have expressed interest in this method- 
ology. Qing Tian (working with Dan Brown) plans to use vulnerability analysis to identify 
the social and physical levers of the well-being of people in the Poyang Lake area of China 
where flooding frequently disrupts economic and social activity. Abe Gong in the depart- 
ment of political science and public policy wants to incorporate these tools for research 
into far-from-equilibrium dynamics in organizational change. Dominick' Wright (working 
with Scott Atran) want to find points of susceptibility to terrorist cell activity; intelligently 
disrupting sustainable operation of terrorist networks might offer low-impact methods to 
benefit national security. Warren Whatley of the Department of Economics and the Center 
for African America Studies would like to apply the path dependency measures to his data 
and econometric model of the 18 th century British slave trade in America to identify any 
lasting effects on African economic and political stability. Chris Chapman of the Multi- 
media Development Team at the University of Michigan Medical School wants to uncover 
user behavior patterns in educational technology in order to improve retention and pinpoint 
weak links to improve educational efficacy. Several other individuals have expressed interest 
in the technique, but the above selection suffices to demonstrate the potential benefits this 
methodology has for substantive research fields across multiple disciplines. 
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This methodology has also garnered interest from the private sector. State Farm insur- 
ance has expressed interest in building a model to better understand the effects of word- 
of-mouth spread in insurance company choices that exploits tipping behavior and path 
dependence. Lockheed Martin is pushing to develop software to read in data from existing 
simulations and engineering tools to build the Markov model and identify the features of 
system dynamics defined herein. Palantir Technologies is considering incorporating these 
analysis capabilities into their social network and financial market analysis software plat- 
forms. Because the methods are designed to be as general possible, algorithms implementing 
them could be constructed as code libraries for popular scientific programming languages 
(Java, C, C++, Python, Matlab, Mathematica, etc.) and made open source for popular 
consumption and widespread use. I have started to pursue government grant funding to 
develop this software package. 

Through each of these applications and others that follow I expectt to uncover excep- 
tions, caveats, refinements, and alternatives to the work as it stands now. I also expect 
to discover many more features of system dynamics that can be uncovered via the Markov 
model representation^] This paper presents a first attempt at capturing the above-defined 
properties; through applied research I will be able to validate these measures' usefulness 
and improve them where necessary. 

9.2 Technique To Construct Markov Diagram from Models or Data 

As mentioned in the text, I have sketched a methodology to generate the Markov model 
representation from data sets (whether from a database or collected from a generative 
model). Because actual data sets and parameter spaces are typically quite large, a tool 
to automatically create the Markov transition diagram is necessary to perform the above 
measurements. Part of designing this tool will be specifying precisely what the restrictions 
and requirements of a data set are. Another part includes providing the algorithms to use 
available data to generate a system's states and transitions properly weighted. Because 
the methodology presented in this paper is essentially a statistical technique (more on this 
below) some time will be spent to demonstrate that the assumptions made are the minimal 
assumptions and that the structure generated is the most justified result from the observable 
sample. 

9.3 Equivalence Classes for System Dynamics 

One major goal of complex systems research is to identify common underlying mathemat- 
ical properties in a myriad of seemingly very different phenomena. The Markov modeling 
technique allows us to create a common representation of almost any system's dynamics. 
Differences in the definitions of system states, however, will still mask many of the similari- 
ties. That difficulty notwithstanding we can make great gains by identifying network motifs 
(repeated patterns in the graph structure) and establishing cross-disciplinary equivalence 
classes of system behavior. Achieving this goal will require solving issues with the choice of 
system resolution and "playing with" the resolution to find the matching patterns. Though 

17 In fact, I already have many more measures not presented in the current work because they do not fit 
snugly into one of the three general categories of dynamics presented. 
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this may sound suspicious, changing the resolution is nothing more than altering the level 
of organization to which we are applying the properties. As long as we are consistent in 
our application of these techniques then we may be able to discover similarities in many 
complex systems' dynamics. 

9.4 Non-Probabilistic Definitions of These Phenomena 

There are two potential non-trivial objections to the above-given probabilistic accounts of 
properties of system dynamics. The first is that probabilistic definitions are inadequate 
because we aim to understand these features as properties that systems possess rather than 
dynamics they might have. To answer this question we may first need a better grasp of 
dispositional versus categorical properties more generally (see below) . But it may be the case 
the other definitions cashed out purely in terms of structural properties of Markov models 
may be what some people would find more intuitive. It could also be that the definitions 
these potential objectors are seeking cannot be formulated within Markov models at all. As 
long as the above definitions reveal useful distinctions and patterns of system behavior the 
project was a success, but still better (or at least different and also useful) measures may 
be available if build from a different formal foundation. I will, naturally, continue to pursue 
other and hugely different measures of system dynamics. 

The other objection to the probabilistic definitions provided is that a person may insist 
that for many of these concepts the definition is incomplete without the causal explanation 
for how it comes about. Like all other statistics-like approaches (see "metastatistics" be- 
low) these measures may be realized by many different micro-level dynamics. Some of those 
dynamics may not seem proper candidates for robustness or tipping behavior even if the 
data they generate reveals it as such from this analysis. But if this were to happen then I 
would consider the project a huge success. This would be similar to discovering scale-free 
degree distributions in many different networks from disparate research fields. Finding that 
common property urged researchers to pursue more deeply the phenomena and they even- 
tually uncovered several different mechanisms by which scale-free network may be created. 
Our understanding of each of those systems greatly increased because we had a common 
yardstick with which to measure them. The probabilistic measures presented here are not 
intended to replace or make unnecessary the deeper scientific analysis - they are supposed 
to foster it. 

9.5 Investigating Dispositional Properties 

While working on the formal definitions of robustness-related properties I realized that 
these are all dispositional properties; and dispositional properties constitute a long-standing 
philosophical problem. That connection immediately made me wonder if my mathematical 
formalism might shed some new light on how to differentiate dispositional properties from 
categorical ones. Dispositional properties are philosophically troubling for many reasons, 
but primarily these stem from the question of whether their subjunctive conditional status 
distinguishes them from categorical properties. It may therefore be interesting to consider 
how to apply my methodology to investigate other dispositional properties such as soluble, 
malleable, affordable, and differentiate them from other properties with accepted neces- 
sary and sufficient conditions. If in addition to the obvious and direct application of this 
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methodology to improve the performance capabilities of systems my research also produces 
insights into the nature of dispositional properties in general that would be unanticipated 
but certainly welcome news. Let's look at some details of the problem. 

A big part of the problem is that any property can be given a subjunctive conditional 
description, but a property would be dispositional if and only if such a definition is the only 
possible one. Color properties are known as primary properties and should be excellent 
candidates of clear-cut categorical properties. Yet being red is dispositional in the sense 
that nothing seems red in the dark. Whether or not redness (or conductive, or triangular, 
or . . .) is dispositional in the same way that fragility is has not been solved. My math- 
ematical analysis reveals how particular dispositional properties (robustness-related ones) 
are behavioral in nature and emerge from the microbehavior of the system components. 
What I hope is that this can be expanded to develop necessary and sufficient conditions for 
properties to be dispositional in different ways ... or at least a step in a helpful direction. 

9.6 Metastatistics 

I have said elsewhere in this paper that I consider the methodology presented here to be 
similar in kind to statistics. It starts with data (perhaps generated from simulations of 
a model), fits a model (a Markov model) to the data, and then purports to describe the 
real system with measures over that model (my definitions). Statistics as we usually see 
it takes a different kind of model (some form of distribution or estimator), but its purpose 
and general method of attack are very similar. And this procedure is clearly different from 
other sorts of models in that neither standard statistics nor my methodology can explain 
the phenomena being analyzed. Statistics (and my methodology) can produce evidence 
that some generative theory-driven model does explain the observed data, but the theory 
behind the generative model is what is doing the explaining. 

Standard statistics and my methodology are certainly not unique in their abilities to 
measure but not explain phenomena. Much of complex network analysis can be seen in 
this light as well. The network representation facilitates the calculation of measures on the 
generating data but not because the links identified in the network representation are in 
the actual system's features. Classifier systems, Bayes nets, hidden Markov models, and 
neural nets are all further examples where the formal representation can permit measures 
and produce predictions without mirroring the structure and dynamics of the underlying 
behavior-generating system. Seeing all these different techniques under the same metasta- 
tistical light may allow us to 1) bridge gaps among these techniques, 2) identify broader 
guidelines for the proper application and interpretation of these techniques, and 3) find new 
statistics-like techniques with desired features. 
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